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Abstract —Display-camera communication has become a 
promising direction in both computer vision and wireless com¬ 
munication communities. However, the consistency of the channel 
measurement is an open issue since precise calibration of the 
experimental setting has not been fully studied in the literatures. 
This paper focuses on establishing a scheme for precise calibra¬ 
tion of the display-camera channel performance. To guarantee 
high consistency of the experiment, we propose an accurate 
measurement scheme for the geometric parameters, and identify 
some unstable channel factors, e.g.. Moire effect, rolling shutter 
effect, blocking artifacts, inconsistency in auto-focus, trembling 
and vibration. In the experiment, we first define the consistency 
criteria according to the error-prone region in bit error rate 
(BER) plots of the channel measurements. It is demonstrated 
that the consistency of the experimental result can be improved 
by the proposed precise calibration scheme. 

1. Introduction 

Display-camera communication has recently gained signif¬ 
icant attention due to the pervasive and advancing of mobile 
phone camera O, ( 21 , O, (H, Q. In the channel transmitter, 
the message is encoded and modulated into an image frame, 
e.g., a barcode image, and show on a conventional display. 
At the receiving end, a mobile camera serves as the receiver. 
The advantages of such display-camera channel are non-trivial. 
Eirstly, the communication requires no extra hardware module 
except a pair of camera and display which are available on 
almost each off-the-shelf mobile phone. Secondly, compared 
with existing short range wireless communication technology, 
it requires no transmissions in the ever congested spectrum 
band and therefore creates no inferences with other devices. 
Last but not least, the security and privacy during com¬ 
munication can be well controlled by adjusting the visible 
distance and direction ID, m. The potential applications of 
the display-camera communications includes, but not limit 
to, information retrieval in a shopping mall from a large 
display, teaching material distribution in a classroom from 
the projector, multimedia file sharing from phone to phone 
between different users. The advantages are obvious and the 
potential applications are promising. 

Researchers have been working on improving the channel 
reliability and throughput. Very few attentions have been 
paid to the experimental setup of the display-camera channel. 
However, the experimental parameters calibration is not a 
trivial problem. Eirstly, it is not an easy task to set the 
experimental parameters accurately. In particular, it is difficult 
to calibrate the capturing angles between display and camera 
with conventional measurement tools, e.g., ruler and protractor. 


What’s worse, it is found that the channel performance is 
sensitive to the experimental setting especially when high 
channel throughput is needed. As is shown in Section the 
channel performance has changed significantly even though 
the experimental setting deviates 2 degree in angle and 3 cm 
in the distance. In the literatures, some works focus on the 
case without perspective distortion (Tl, (H which is an ideal 
case in the practical applications; while others consider a wide 
range of capturing angles but no details on the measurement 
are given (1, O, n. 


The imprecise description of the experiment setting and 
the sensitivity of the channel performance lead to the issue 
of low consistency of the channel measurement results. How¬ 
ever, consistency is the fundamental requirement of scientific 
experiments since the demonstration of experimental result 
shouldn’t be based on a single event ii- In this paper, we 
aim at addressing the issue of consistency of the display- 
camera channel measurements. The paper is organized as 
follows. Section [n| d escribes our proposed channel calibration 
scheme. Sectionlllll shows the consistencies of the channel 
measurement results with or without considering the proposed 
calibration method. Section |lv| concludes this paper. 


H. The Proposed Channel Calibration Scheme 

In this section, some detail treatments of the experimental 
setup are proposed to guarantee the consistency of the exper¬ 
iment results. The contributions are mainly in two parts: 

A. Ensure accurate geometric setups of the experiment: 

To guarantee results with high consistency, the experimen¬ 
tal parameters must be measured and set with ultimate 
care. We divide the parameters into two independent sets, 
i.e., the geometric and non-geometric parameters. The 
geometric ones include the display to camera distance, 
the capturing angle between the camera and display, the 
barcode resolutions/sizes on display and camera, etc. On 
the other hand, ambient light intensity, display brightness, 
image blurriness are classified as the non-geometric pa¬ 
rameters which describes the transmitted signal energy. In 
this paper, we focus on the geometric parameters since the 
experimental results are more sensitive to the geometric 
parameters than the non-geometric ones. Especially, the 
capturing angle and the captured barcode size affect the 
channel performance heavily O due to the change of 
received signal energy. 




(a) 


(b) 



Fig. 1. The experimental setup, (a) A demo with 20 degree capturing angle 
using Nexus 5 and the new iPad. The alignment points are circled, (b) The 
barcode pattern used in our experiment and the illustration of slicing operation. 


B. Avoid unstable channel states: An experiment with cer¬ 
tain experiment setting (experiment state point) is consid¬ 
ered as consistent only when “there is an open set around 
that point within which the result of that experiment is the 
same” In each setup of the display-camera commu¬ 

nication channel, it presences one or multiple dominant er¬ 
ror factors. The dominant factors can be a specific process 
of the decoding pipeline. For example, the barcode comer 
detection, image binarization, symbol synchronization, etc. 
It is important to identify these factors and ensure that 
they are not changed in another instance of the experiment 
setup. Therefore, it is cmcial to identify the dominant error 
sources in the channel and avoid conducting experiments 
in the unstable states where the experimental results are 
sensitive to tiny deviation of the setup. 

In the following subsections, details on the above men¬ 
tioned two aspects will be given. 

A. Precise Setup of the Geometric parameters 

To have a precise setup of the geometric parameters, we 
propose to use four reference points to align with the barcode 
corners as illustrated in Fig. (a). Given a fix displayed 
barcode size, the four points are set such that the aligned 
barcode is with the desirable capturing angle, distance and 
image resolutionp. Once the four barcode comers are aligned 
with the reference points and the displayed barcode size is fix, 
all the geometric parameters are set accurately. The problem of 
setting the geometric parameters accurately has been simplified 
to alignment of the four corners. The calculations of the four 
alignment points are explained with the display-camera model 
illustrated in Fig. 

In the Pin-hole camera model illustrated in Fig. (a), the 
displayed barcode A'B'C'D' on display plane x'y'is mapped 
to the captured barcode ABCD on camera sensor plane xy. 
The camera principle axis z passes through the optical center 
O, the captured barcode center Oc and the displayed barcode 
center Od- The distance between the displayed barcode center 
to the optical center 00d is denoted as d, while / is the focal 
length parameter which is fixed in most off-the-shelf phone 
cameras la, cni. In this model, for the ease of experimental 
setup, the capturing angle a is set as with one degree of 
freedom, i.e., ^ is co-plane with x'z' and the angle between z 
and z' is a. For experiments which study multiple degree of 
freedoms, the angle with other planes can always be added. 




Fig. 2. The Pin-hole camera geometry model: (a) The mapping from display 
plane (x'y') to image plane (xy); (b) Illustrate the calculation of AOc from 
A'Od with the principle of similar triangles; (c) the captured barcode on the 
image plane. 


Let the displayed barcode size be m x m, and M, M' in 
Fig. ^(a) be the center of AB and A'B', respectively. Based 
on the principle of similar triangle for AqmOs ^omp 
illustrated in Fig. (b), it can be calculated that 


\MOs\ 


f • m • cos a 
2d — m ’ sinct 


( 1 ) 


On the other hand, triangles Aqam and Aqa'M' are also 
similar triangles, i.e.. 


\AM\ _ \MO\ _ \MOs\ 

I AM' I “ |M'0| “ \M'P\ ‘ 

Given that |AM'| = m, |AM| can be computed as 

\AM\ = - 

2d — m ' sin a 


( 2 ) 

( 3 ) 


With \MOs\ and |AM|, the coordinate of point A w.r.t the 
origin of the image sensor Og can be calculated, so as the 
coordinates for other three comers. The locations of the four 
corners can be computed as: 


^ = (- 
B = ( 
C = ( 


f-m 


f-m • cos a 

2(i — m • sin cr ’ 2d — m • sin cr 
f ' m ' cos a / • 

2d-\- m • sin cr ’ 2d + m • sin a 
f ' m ' cos a / • 


D = { 


2d — m ' sincr ’ 
f-m • cos a 


2d — m ' sin a 
f-m 


2d-\-m-sma^ 2d-\-m-sma 


It should be noted that the above location in length should be 
converted to image coordinates with the knowledge of pixel 
size on the imaging sensor. During the experiment, four corner 
locations will be calculated according to the predetermined 
parameters and the above geometric model. The computed 
coordinates are marked in the preview window on the mobile 
App. Therefore, the problem of setting the geometric param¬ 
eters accurately has been simplified to alignment of the four 
barcode corners to the reference points. 








































B. Avoid the Unstable Experiment States 

In this part, we discuss several undesirable factors of the 
experiment setup which leads the unstable experiment states. 
The settings come from a wide range of factors including 
the trembling of camera, the modulation scheme of LED 
display, the auto focus operation of camera, the sampling of 
the displayed pixels with the camera sensor, and the effect 
of tiny vibrations. In the following, detail discussions will be 
presented for these factors. 

1) Avoid rolling shutter effect from the CMOS sensor: 
Rolling shutter scheme is a popular data acquisition scheme for 
the digital camera with CMOS sensor. It reads out the imaging 
data from the CMOS sensor pixels row by row sequentially 
from top to bottom ifTTIl . This is a common scheme in the state- 
of-the-art high resolution CMOS sensor to enable the sensor 
to continuously gather photons during the exposure process 
and thus increase the sensitivity of the imaging sensor. The 
major disadvantage for the rolling shutter scheme is that the 
time difference between retrieving the pixel data from the top 
and bottom of the sensor introduces time delay and therefore 
the rolling shutter effect 1 T 21 Thus, it is not appropriate to be 
used in capturing the scene with fast-changing environment. 

Unfortunately, the display-camera channel can be viewed 
as a periodic fast-changing channel over space due to the 
Pulse-Width Modulation (PWM) scheme which are popularly 
used in the conventional displays ca PWM scheme is 
used to control the brightness or the backlight intensity of 
a screen. Due to the binary nature of the display back light, 
a pixel can only be turned on or off which corresponds to 
the maximum or minimum pixel intensities, respectively. To 
display gray level images, the PWM driver turns on the each 
pixel for a certain duration in each duty cycle to achieve the 
intermediate brightness levels. For a typical display driven by 
PWM scheme, the full duty cycle is about 5.5 ms fnt . If 
the brightness level is set to 50%, the pixel is turned on and 
off for the same duration, i.e., 2.75 ms, in each duty cycle. 
On the other hand, the typical image exposure time for each 
video frame is from 1/200 to 1/30 s which means the time 
differences between retrieving the top and bottom row is much 
larger than the on-off durations ifT^ . Therefore, several bright 
and dark bands correspond to the PWM on-off durations in 
each duty cycle can be observed in a single captured image 
due to the rolling shutter effect. 


Fig. 3. Barcode images with (left) and without (right) rolling shutter effect 
from the Dell E2313H display (Td) (driven by PWM scheme). 

In order to remove the roller shutter effect on the display 
with PWM scheme, the brightness level should be tuned to full 
so that the transmitted signals is kept as static for each display 
pixel. As demonstrated in Fig.[^ the rolling shutter effect with 
alternative dark and bright patterns can be observed clearly 
in the left image with 50% display brightness; while it is 
eliminated with full brightness level and disable any automatic 


brightness adjustments. An alternative approach is avoid using 
the display with PWM scheme, a list of the possible choice of 
PWM free monitor can be found at ca. 

2 ) Avoid inconsistency from auto-focus operation: Auto¬ 
focus refers to the camera operation which automatically adjust 
the distance from the lens and imaging sensor so that the 
capture image is visually sharp ca. There are two types 
of auto-focus techniques, i.e., active and passive auto-focus. 
Active auto-focus measure the distance between the camera 
and the object of interest with an infrared beam and adjust 
the sensor-to-lens distance accordingly; while the passive one 
takes a series of video frames with varying sensor-to-lens 
distances and pick the best one by inspecting the image quality 
metric, e.g., contrast, in each image. Passive auto-focus is the 
dominating one in the state-of-the-art mobile phone cameras. 
Thus, it is of our main interest. 

However, each trial of auto-focus may produce different 
results even if the geometric setting is fixed. This is mainly 
due to two reasons. First, the limited resources at hand, e.g., 
low quality of the image sequences, strict time constraint 
and limited computational power in the metric calculations. 
Second, the metric differences between the adjacent frames 
are usually very small due to the simple quality metric and 
the large depth-of-field of the mobile phone camera ifTTll . The 
slight difference in the sensor-to-lens distance across different 
images produce significant change of image quality in a single 
experiment. In order to maintain the consistency during the 
experiment, we suggest to turn off the auto-focus function after 
one trial at the beginning of each experiment, and the barcode 
image collection starts only after the auto-focus operation has 
finished. 

In order to freeze the auto focus function, a modification 
to the auto focus loops was made. As shown in Algorithmic 
an indicator counter has been added to the generic auto-focus 
handling algorithm ca to fix the focus setting after the camera 
focus is properly set. 


Algorithm 1 The One Time Auto-Focus Algorithm 
1: Set auto-focus states: counter = 0 md focusing = 0; 
2: Initialize preview mode parameters; 

3: loop: 

4: if counter = 0 then 
5: focusing = 1; 

6: goto AUTO-FOCUS. 

7: close; 

8 : 

9: procedure Auto-focus 
10: if Find best focus lens = SUCCESS then 

11: counter = 1; focusing = 0; 

12: else 

13: counter = 0; focusing = 0; 


3) Avoid Moire effect from the display: It is well known 
that recapturing an images from the display without careful 
setup introduces the Moire effect. It is due to aliasing from 
sampling the display pixel grid with the camera sensor pixels 
m. The barcode detection performance is heavily affected 
by the Moire pattern since it introduces false barcode region. 
What’s worse, the pattern is very sensitive to the geometric 














setting. A tiny shift in the camera position could lead to 
huge change of the Moire pattern thereafter affects the overall 
decoding performance. Researchers have been working on 
possible solutions to avoid the Moire effect in the recaptured 
image. Some suggestions are made to eliminate the Moire 
patterns, such as intentionally avoid sharp focus and preprocess 
the image with a frequency domain filter. However, these 
operations limit the sharpness of the barcode image and 
introduce inevitable loss into the images. Recently, Muammar 
and Dragotti iEi model the structure of the display pixel 
grid as 2D square form and show that the artifacts can be 
eliminated by simply setting the display-camera distance to a 
predetermined value. The distance can be calculated by the 
knowledge of camera focal length, the display and camera 
sensor pixel sizes, that is. 


4-2/(—+ —+ lj 


(4) 


where dk is the desirable distance, Tg , are the pixel sizes on 
camera sensor and display, respectively, and k is an arbitrary 
integer. With any integer k, the calculated distance dk can 
effectively eliminate the Moire pattern on the captured image. 
For a generic setting with the new iPad display and the Nexus 
4/5 camera, we have = 0.097 mm (iPad), = 1.1 jim 
(Nexus 4) or 1.4 jim (Nexus 5), and / = 4.6 mm (Nexus 4) 
or 4.0mm (Nexus 5) Qol, Go). The Moire pattern eliminating 
distances for both sets of equipment have been calculat ed in 
Table The four reference points mentioned in Section II-A| 
will be determined based on these Moire pattern eliminating 
distances. Therefore, Moire pattern in the captured image is 
a good indicator of whether the geometric setting is precise 
enough. 


TABLE L Capture distance with no Moire pattern (in meter). 


^Equipment 

1 

2 

3 

4 

5 

The new iPad with Nexus 4 

0.21 

0.11 

0.077 

0.060 

0.050 

The new iPad with Nexus 5 

0.15 

0.078 

0.055 

0.043 

0.036 


It should be noted that this scheme works only when the 
display and camera planes are parallel. However, it brings 
insightful clues for the choice of equipment which can alleviate 
the Moire pattern. As being the dominant terms in the 
bracket of Eq. a smaller display pixel size results in a 
smaller range for the Moire pattern eliminating distances which 
benefits different parts of the image with different but similar 
display to camera distance. In other words, even when the 
display and camera planes are not parallel, a display with 
higher PPI (Pixels Per Inch) produces less obvious Moire 
effect. 

4) Avoid Trembling and Vibration: Display camera com¬ 
munication is pervasive and sometime ad hoc. The camera 
devices could be handheld with no stable station. This lead to 
the difficulty of producing consistent channel measure since 
the irregular hand trembles. This leads to unexpected motion 
blur of the captured images which lead to degradation of the 
image quality and the loss of parts of an image frame 1211 
HI- In order to avoid abrupt change of the communication 
channels, it is suggested that a stationary platform with ad¬ 
justable freedom in the viewing angle should be used to hold 
the camera. One example of such equipment is a mini tripod 
as shown in Fig. [3 (a). 


Besides the hand trembling, some tiny mechanical vibra¬ 
tions also causes the unexpected camera motion. Early studies 
12^ 12^ show that the mechanical vibration introduces inter¬ 
pixels interferences and limits the performances of an imaging 
sensor. The situations is worsen in our cases since a display 
is used as the transmitter. On the one hand, some inevitable 
Moire patterns are produced when the display and camera 
planes are not parallel. As discussed in Section |II-B3| the 
Moire effect is generated by sampling the display pixel grid 
with the camera sensor pixels. It is extremely sensitive to the 
vibration in the display camera channel. A small vibration of 
the camera or display leads to a big change of the Moire pattern 
which heavily affects the image preprocessing results, e.g., 
binarization output. On the other hand, the vibration causes 
tiny shifts of the barcode comers in the captured images. 
The slight difference in pixel or even sub-pixel level leads 
to very different results in the corner detection and symbol 
synchronization steps. 

In the literatures, researchers have proposed several ap¬ 
proaches to solve the issue caused by vibration. Siebert et al 
1241 shows that the vibrations can be well estimated with a 3D 
homography setup using calibrated two cameras. In our setup, 
a pair of consecutive images can be considered as images from 
two independent camera. The vibration between the two image 
frames can then be estimated using the same homography 
model and corresponding compensation can be carried out. 
The advanced mobile phones offers image stabilization func¬ 
tionality in optical and software level. For example, the iPhone 
6 Plus 1^ employs optical image stabilization which takes 
advantages of gyroscope and the motion sensors to measure 
motion data and provide accurate information on the lens 
movement. The motion blur produced by hand shake can then 
be compensated even under lower light condition. 

Therefore, the experiment setup is suggested to be stationed 
at a desk without any vibration sources, such as, computer 
cooling system, hard disk motor, etc. A tablet which has no 
moving components is very suitable display for our exper¬ 
iment, and the phone models with image stabilizer for the 
camera is preferable. 

HI. Experimental Results 

In this section, the experimental procedure is firstly intro¬ 
duced and the experimental results with and without consid¬ 
ering the proposed channel calibration scheme are shown. 

A. Introduction to Experimental Procedure 

The purpose of the display-camera channel calibration 
experiment is to identify the range of error-prone region since 
it is important in error correction code with unequal error 
protection (UEP) 1261 and other advanced coding schemes. In 
this part, we first describe our experimental setting to produce 
consistent results and followed by a methodology to analyze 
the experimental results. 

1) Experimental setups: Given the considerations dis¬ 
cussed in Section [I^ the experimental parameters are set as 
follows: 

• Display: the new iPad with Retina display (2048 x 
1536 pixels); 
















• Camera: Nexus 4/5 run in VGA (640 x 480 pixels) 
preview mode; 

• Camera stand: A mini tripod with adjustable orienta¬ 
tion and height; 

• Barcode pattern: a generic binary barcode with 
datamatrix-like structure as shown in Fig. (b). 

• Barcode size: 10 x 10 cm^ on display; 

• Barcode dimension: 87 x 87 module^; 

• Distance: 21 and 15 cm from the camera to barcode 
center for Nexus 4 and 5, respectively, according to 
Eq. 0; 

• Capture angles: -20, 0, and 20 degree. 

• Brightness: 250-350 lx as measured by a lux meter. 


It should be noted that our barcode pattern is not exactly 
the same as the datamatrix code (271. The main difference is 
that our barcode pattern has an odd number of modules in 
each dimension (e.g., 87 in our setup) while the datamatrix 
code has an even number of modules. This has been modified 
to improve the detection accuracy of the top right comer. 
However, our scheme of the channel calibration does not limit 
to a specific barcode pattern. For the barcode dimension, it 
is chosen since it demonstrates the high throughput (85 x 85 
bits/frame) performance which is of our main interest. The 
display-camera distance is fine-tuned to minimize the effect 
of Moire pattern according to Eq. 0 - The setting of capture 
angles covers a wide range of practical applications. For each 
angle setting, we pr e-com pute a set of four reference points 
as shown in Section II-A The user are required to align the 
reference points with the barcode corners. A simple demo of 
the 20 degree experimental setting are shown in Fig. (a). 


In each set of experiment, 500 images are collected to 
achieve high reliability, i.e., a good enough confidence interval. 
The 95% confidence interval can be computed by 1^ : 


Ic = (5) 


where p is the BER for a given module and Nj is the number of 
images, i.e., 500 for our experiment. It means the actual BER 
has 95% probability to be in the interval [p — Ic,p Ic]- 
For p = 0.1, Ic = 0.026 and the 95% confidence interval 
[0.074,0.126]. In other words, with 500 images and 0.1 BER, 
the experiment result has achieved 95% confidence interval 
in ±0.026 interval. The 95% confidence interval for p = 
0.2,0.3,0.4 can also be computed as ±0.036, ±0.042, ±0.044. 

2 ) Result Analysis: Consistency Measure: After collecting 
the barcode images, they are forwarded to the decoder and 
the demodulation bit error rate (BER) plot is generated by 
assembling the error probability of each modules according 
to the module position. As illustrated in Fig. the error 
plot is overlaid with the barcode image to shown the position 
correspondences. The BER value at a given position in the 
xy-coordinate shows the performance of the corresponding 
barcode module. In this toy example, an error-prone module 
with 0.1 error rate is found at the center of the barcode region. 

Across different experiments, the BER plots are compared 
to evaluate the consistency of the experiments. In this study, the 
locations of the error-prone region rather than the amplitudes 
of individual peaks are of our main interest since the error- 
prone locations are the primary concerns of some advanced 


(Error rate) 



Fig. 4. An illustration of the bit error rate plot over the barcode region. 


error protection schemes and channel studies. Therefore, pre¬ 
processing of the BER plots is needed to eliminate the noisy 
spikes before evaluating the consistency. One generic approach 
is that a thresholding operation is applied on the BER plots so 
that only the dominant peaks are kept, and the region within 
D modules LI-distance to the dominant peaks are labeled 
as the error-prone region. Pi and P 2 . In the experiment, the 
threshold is empirically selected to be 50% percent of the 
mean amplitude of the top 10 dominant peaks and D is set to 
be 3 module. The common error-prone regions in both BER 
plots are obtained by Pi Q P2, while the overall error-prone 
region are Pi |J P2. Pc and Ea denotes the number of nonzero 
modules for the intersection and union sets, respectively. 
Finally, the consistency metric is defined as: 

R = EjEa (6) 

The higher the metric, the more consistent the two experiments 
are. 


B. Consistency Experiment: with the Proposed Scheme 

In this part, we demonstrate that the consistencies of 
the experiments can be maintained by accurately setting the 
geometric with the proposed scheme. As shown in Fig. the 
consistency metrics for the above distributions are computed 
as 0.56 for -20 degree, 0.39 for the 0 degree, and 0.77 
for 20 degree. It can be seen that the top left and bottom 
left corner regions are the error-prone positions in the error 
plots regardless of the capturing angles. This is due to the 
datamatrix-like finder and timing patterns design. As can be 
seen in Fig. (b), the top and right edges of the barcode 
consist of alternative black and white modules which are used 
in the symbol synchronization. Errors in locating the barcode 
position heavily affects the symbol synchronization accuracy. 
This is due to the red slicing lines for symbol alignment are 
drawn from top to bottom or from right to left. The top left, 
bottom left and bottom right corner regions suffer the most 
from the symbol synchronization errors. 

It is also worth mentioning that the differences of the 
amplitude in the two corresponding error plots are due to small 
alignment differences in the two experimental setting. As can 
be seen in Fig. the first set of images has higher detection 
accuracy in the bottom left corner than that of the second 
ones. Thus, smaller symbol synchronization error and lower 
amplitudes in the BER plot are obtained for the first set of 
images. 








trail 1 



Fig. 5. The BER plots for our experimental results at -20, 0 and 20 degree capturing angle with Nexus 5 camera and the new iPad display. The consistency 
metrics for the three columns are: 0.56, 0.40 and 0.77 for the -20, 0 and 20 degree conditions, respectively. 



Fig. 6. The corner detection and symbol synchronization results for both 
experiments in the case of 20 degree capturing angle. Top: the detected 
bottom left corners marked with red dots; Bottom: the corresponding symbol 
synchronization performances at the bottom left region. 


The results for both Nexus 4 and Nexus 5 are summarized 
in Table (n] It is understandable that when the channel dis¬ 
tortions are strong and deterministic, the experiments should 
have high consistency. For example, under -20 and 20 degree 
perspective distortion, the consistency scores are generally 
higher than those of experiments at 0 degree. 


TABLE II. The Consistency Scores. 


■—---_____Angle (in degree) 

-20 

0 

20 

Equipment ~~~——— 

The new iPad with Nexus 4 

0.68 

0.52 

0.82 

The new iPad with Nexus 5 

0.56 

0.40 

0.77 


C. Inconsistent Experiments: without the Proposed Scheme 

Slight deviations in the geometric parameters could lead 
to very different decoding performance and therefore a very 
different error plot. Without precise calibration of the geomet¬ 
ric parameters, the consistency of experimental results from 
independently collected images can not be guaranteed. In this 
part, we show that a small inaccuracy in setting the angle and 
distance lead to totally different decoding performance. 

One set of experimental images are collected with -22 
degree angle and 18 cm distance using Nexus 4 and the new 
iPad. Such deviations can easily be made if the angle and 
distance measurements are not done properly. For example, 
measuring the distance when the phone and display are not 
properly aligned (O, Os and Od do not lie on the same axis 
as shown in Fig. [^, and roughly setting the angle with a 
pair of protractor and rule. It turns out that the consistency 
score drop significantly when compared to the error plots with 
precise geometric setups. As shown in Fig. [ 7 ] (a) and (b), 
the position of error-prone region has changed significantly 
and the consistency score has dropped to 0.22 though the 
geometric setup only deviates 2 degree in viewing angle and 3 
cm capturing distances. The error-prone region near the right 
edge is due to the lens distortion gets more and more serious 
when the viewing angle increases and the capturing distance 
decreases as shown in Fig. [ 7 ] (c). 
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Fig. 7. Error plots of the experimental results by Nexus 4 and the new iPad 
with: (a) precise geometric setting, i.e., -20 degree and 21 cm; (b) -22 degree 
and 18 cm. (c) The synchronization error due to lens distortions in the right 
edge of the barcode. 


IV. Conclusion 

In this paper, we have established a precise calibration 
scheme for the geometric parameters in the display-camera 
communication channel. Four reference points have been pre¬ 
computed according to the predetermined geometric parame¬ 
ters. The problem of accurate setup of the parameters has been 
simplified to alignment of four comer with the four reference 
points. Careful settings of the equipment and experimental 
parameters are also needed to avoid some unstable channel 
states, such as. Moire effect, rolling shutter effect, blocking 
artifacts, auto-focus inconsistency, trembling and vibrations. In 
the experiment, the BER error plots of the captured barcode 
images are analyzed and the consistency criteria is defined. We 
demonstrate that setting the geometric parameter accurately 
and avoiding the unstable factors with the proposed scheme 
can improve the consistency of the experiment significantly. 
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